Weipeng Xu
Short Biography
Weipeng Xu is a research scientist at Facebook Reality Labs Research in Pittsburgh. He was a post-doctoral researcher at the Graphic, Vision & Video group of Max Planck Institute for Informatics in Saarbrücken, Germany. He received B.E. and Ph.D. degrees from Beijing Institute of Technology in 2009 and 2016, respectively. He studied as a long-term visiting student at NICTA and Australian National University from 2013 to 2015. His research interests include virtual human character, human pose estimation and machine learning for vision/graphics.
Research Highlights
Human performance capture
3D human pose estimation
Neural rendering
Dynamic scene reconstruction
Virtual and augmented reality
3D computer vision
Machine learning for vision/graphics
Publications
PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time
Soshi Shimada, Vladislav Golyanik, Weipeng Xu, Christian Theobalt
Siggraph Asia 2020
Neural Re-Rendering of Humans from a Single Image
Kripasindhu Sarkar, Dushyant Mehta, Weipeng Xu, Vladislav Golyanik, Christian Theobalt
ECCV 2020
XNect: Real-time Multi-person 3D Human Pose Estimation with a Single RGB Camera
Dushyant Mehta, Oleksandr Sotnychenko, Franziska Mueller, Weipeng Xu, Mohamed Elgharib, Pascal Fua, Hans-Peter Seidel, Helge Rhodin, Gerard Pons-Moll, Christian Theobalt
Siggraph 2020
Neural Human Video Rendering by Learning Dynamic Textures and Rendering-to-Video Translation
Lingjie Liu, Weipeng Xu, Marc Habermann, Michael Zollhoefer, Florian Bernard, Hyeongwoo Kim, Wenping Wang, Christian Theobalt
TVCG 2020
Video (coming soon)
DeepCap: Monocular Human Performance Capture Using Weak Supervision
Marc Habermann, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt
CVPR 2020 (Oral)
EventCap: Monocular 3D Capture of High-Speed Human Motions using an Event Camera
Lan Xu, Weipeng Xu, Vladislav Golyanik, Marc Habermann, Lu Fang, Christian Theobalt
CVPR 2020 (Oral, Best Student Paper Honorable Mention)
Monocular Real-time Hand Shape and Motion Capture using Multi-modal Data
Yuxiao Zhou, Marc Habermann, Weipeng Xu, Ikhsanul Habibie, Christian Theobalt, Feng Xu
CVPR 2020
In the Wild Human Pose Estimation Using Explicit 2D Features and Intermediate 3D Representations
Ikhsanul Habibie, Weipeng Xu, Dushyant Mehta, Gerard Pons-Moll, Christian Theobalt
CVPR 2019 (Oral)
Learning a Disentangled Embedding for Monocular 3D Shape Retrieval and Pose Estimation
Kyaw Zaw Lin, Weipeng Xu, Qianru Sun, Christian Theobalt, Tat-Seng Chua
arxiv 2018
LiveCap: Real-time Human Performance Capture from Monocular Video
Marc Habermann, Weipeng Xu, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt
ACM TOG 2019
Neural Rendering and Reenactment of Human Actor Videos
Lingjie Liu, Weipeng Xu, Michael Zollhoefer, Hyeongwoo Kim, Florian Bernard, Marc Habermann, Wenping Wang, Christian Theobalt
ACM ToG 2019
Mo2Cap2: Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera
Weipeng Xu, Avishek Chatterjee, Michael Zollhoefer, Helge Rhodin, Pascal Fua, Hans-Peter Seidel, Christian Theobalt
IEEE TVCG Proc. VR 2019 (Best Journal Paper Honorable Mention)
MonoPerfCap: Human Performance Capture from Monocular Video
Weipeng Xu, Avishek Chatterjee, Michael Zollhöfer, Helge Rhodin, Dushyant Mehta, Hans-Peter Seidel, Christian Theobalt
ACM TOG 2018
Hyeongwoo Kim, Pablo Garrido, Ayush Tewari, Weipeng Xu, Justus Thies, Matthias Nießner, Patrick Pérez, Christian Richardt, Michael Zollhöfer, Christian Theobalt
ACM TOG Proc. SIGGRAPH 2018
Detailed Human Avatars from Monocular Video
Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, Gerard Pons-Moll
3DV 2018
A Hybrid Model for Identity Obfuscation by Face Replacement
Qianru Sun, Ayush Tewari, Weipeng Xu, Mario Fritz, Christian Theobalt, Bernt Schiele
ECCV 2018
Single-Shot Multi-Person 3D Body Pose Estimation From Monocular RGB Input
Dushyant Mehta, Oleksandr Sotnychenko, Franziska Mueller, Weipeng Xu, Srinath Sridhar, Gerard Pons-Moll, Christian Theobalt
3DV 2018
Video Based Reconstruction of 3D People Models
Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, Gerard Pons-Moll
CVPR 2018 (Spotlight)
Illumination-invariant Robust Multiview 3D Human Motion Capture
Nadia Robertini, Florian Bernard, Weipeng Xu, Christian Theobalt
WACV 2018
NRST: Non-rigid Surface Tracking from Monocular Video
Marc Habermann, Weipeng Xu, Helge Rhodin, Michael Zollhoefer, Gerard Pons-Moll, Christian Theobalt
GCPR 2018 (Oral)
VNect: Real-time 3D Human Pose Estimation with a Single RGB Camera
Dushyant Mehta, Srinath Sridhar, Oleksandr Sotnychenko, Helge Rhodin, Mohammad Shafiei, Hans-Peter Seidel, Weipeng Xu, Dan Casas, Christian Theobalt
ACM TOG Proc. SIGGRAPH 2017
Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervision
Dushyant Mehta, Helge Rhodin, Dan Casas, Oleksandr Sotnychenko, Weipeng Xu, Christian Theobalt
3DV 2017
Deformable 3D Fusion: From Partial Dynamic 3D Observations to Complete 4D Models
Weipeng Xu, Mathieu Salzmann, Yongtian Wang, Yue Liu
ICCV 2015
Nonrigid Surface Registration and Completion from RGBD Images
Weipeng Xu, Mathieu Salzmann, Yongtian Wang, Yue Liu
ECCV 2014
Real-time keystone correction for hand-held projectors with an RGBD camera
Weipeng Xu, Yongtian Wang, Yue Liu, Dongdong Weng, Mengwen Tan, Mathieu Salzmann
ICIP 2013
iSarProjection: A KinectFusion Based Handheld Dynamic Spatial Augmented Reality System
Mengwen Tan, Weipeng Xu, Dongdong Weng
CAD/Graphics 2013
"Soul Hunter": A novel augmented reality application in theme parks
DongDong Weng, Weipeng Xu, Dong Li, Yongtian Wang, Yue Liu
ISMAR 2011